Revisiting Co-Occurring Directions: Sharper Analysis and Efficient Algorithm for Sparse Matrices
نویسندگان
چکیده
We study the streaming model for approximate matrix multiplication (AMM). are interested in scenario that algorithm can only take one pass over data with limited memory. The state-of-the-art deterministic sketching AMM is co-occurring directions (COD), which has much smaller approximation errors than randomized algorithms and outperforms other methods empirically. In this paper, we provide a tighter error bound COD whose leading term considers potential low-rank structure correlation of input matrices. prove space optimal respect to our improved bound. also propose variant sparse matrices theoretical guarantees. experiments on real-world datasets show proposed more efficient baseline methods.
منابع مشابه
Discovering Hidden Relationships via Efficient Co-clustering of Sparse Matrices
We present a new approach for discovering hidden relationships in sparse bipartite data by identifying large, dense biclusters in the corresponding matrix. We motivate a new class of metrics to measure the quality of a bicluster partition, and compare them to existing metrics. We then present a heuristic algorithm that efficiently searches the space of possible co-clusterings for one which maxi...
متن کاملCo-Occurring Directions Sketching for Approximate Matrix Multiply
We introduce co-occurring directions sketching, a deterministic algorithm for approximate matrix product (AMM), in the streaming model. We show that co-occurring directions achieves a better error bound for AMM than other randomized and deterministic approaches for AMM. Co-occurring directions gives a (1 + ")-approximation of the optimal low rank approximation of a matrix product. Empirically o...
متن کاملAn Efficient Fill Estimation Algorithm for Sparse Matrices and Tensors in Blocked Formats
Tensors, which are the linear-algebraic extensions of matrices in arbitrary dimensions, have numerous applications to data processing tasks in computer science and computational science. Many tensors used in diverse application domains are sparse, typically containing more than 90% zero entries. Efficient computation with sparse tensors hinges on algorithms that can leverage the sparsity to do ...
متن کاملEfficient Assembly of Sparse Matrices Using Hashing
In certain applications the non-zero elements of large sparse matrices are formed by adding several smaller contributions in random order before the final values of the elements are known. For some sparse matrix representations this procedure is laborious. We present an efficient method for assembling large irregular sparse matrices where the nonzero elements have to be assembled by adding toge...
متن کاملAn Efficient Algorithm for Sparse Representations
Basis Pursuit (BP) and Basis Pursuit Denoising (BPDN), well established techniques for computing sparse representations, minimize an ` data fidelity term, subject to an ` sparsity constraint or regularization term, by mapping the problem to a linear or quadratic program. BPDN with an ` data fidelity term has recently been proposed, also implemented via a mapping to a linear program. We introduc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v35i10.17065